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SUCWY 

The  um  of  si  Ml*  tors  for  training  maintenance  personnel  Is  becoming  Increasingly  leportant, 
particularly  In  the  ellltary  where  large  niabers  of  young  and  Inexperienced  personnel  uust  learn 
to  Mlntaln  coup  lex  avionics,  weapon,  and  equipment  system.  Maintenance  simulators  have  been 
found  to  be  both  cost-effective  and  training -effective  for  these  purposes.  Because  of  their 
proliferation,  and  the  variety  of  available  typos  of  simulators  that  exist.  It  has  become 
necessary  to  have  a  means  of  distinguishing  one  from  another.  This  paper  presents  a  taxonomy  of 
maintenance  simulators  and  other  useful  Information  designed  to  assist  managers  and  trainers  In 
making  pertinent  acquisition  and  training  decisions.  In  this  taxonomy,  maintenance  simulators 
are  classed  as:  (a)  Stimulated  Actual  Equipment,  (b)  Model  Simulators,  (c)  Panel  Simulators,  and 
(d)  Interactive  Video  Display  Trainers  (IVDTs).  Each  Is  described,  and  cost  comparisons  among 
the  four  types  are  provided  In  a  manner  which  demonstrates  the  usefulness  of  this  taxonomy. 
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PREFACE 

This  technical  paper  relates  to  Project  2361,  Simulation  for  Maintenance  Training, 
Project  1121,  Technical  Training  Development,  and  other  Air  Force  Human  Resources 
Laboratory  (AFHRL)  projects  that  deal  with  simulator  training  devices.  The  author 
wishes  to  acknowledge  Applied  Science  Associates'  (Valencia,  PA  16059)  many 
contributions  to  the  field  of  maintenance  simulator  acquisition,  particularly  the  work 
accomplished  under  Contract  No.  F33615-78-C-0019.  Appreciation  for  the  hard  work 
accomplished  under  this  contract  Is  expressed  to  Applied  Science  Associates  staff 
members.  Lisa  A.  Th ocher,  j.  Thomas  Roth,  and  especially  the  project  manager,  Robert  J. 
Carroll.  Appreciation  Is  also  expressed  to  Nancy  J.  Allln,  and  other  AFHRL  staff 
members,  who  professionally  devoted  their  time  and  talents  to  ensure  that  even  the  most 
minute  details  were  taken  care  of  In  the  preparation  of  this  paper. 

The  primary  objective  of  this  paper  Is  to  familiarize  Air  Force  and  other  DoD 
managers/trainers  with  the  necessary  knowledge  and  skills  for  effective  acquisition  of 
simulator  training  devices.  A  single  simulator  procurer,  effectively  employing  the 
Information  presented  In  this  paper,  could  save  the  DoO  hundreds  of  thousands  or  even 
millions  of  dollars.  As  DoO's  manpower,  equipment,  and  funding  resources  become 
Increasingly  limited,  the  Importance  of  maximally  optimizing  defense  resources  cannot  be 
overemphasized. 
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TAXONOMIC  CONSIDERATIONS  IN  THE  ACQUISITION  OF 
MAINTENANCE  SIMULATORS 


Maintenance  simulators  art  pitying  tn  Incrttslngly  Important  rolt  In  many  training  programs, 
particularly  In  ttia  military,  whart  largt  numbers  of  young  and  Inaxptrltnctd  personnel  must  be 
trained.  With  the  proliferation  of  maintenance  simulators,  a  great  deal  of  confusion  has  arisen 
as  to  what  really  constitutes  a  'maintenance  simulator."  This  general  term  covers  a  wide  range 
of  training  devices,  varying  widely  In  their  resemblance  to  the  actual  equipment  In  terms  of 
physical  and/or  task  fidelity.  Mhen  people  speak  of  maintenance  simulators,  they  may  have  In 
mind  aay  number  of  alternatives,  based  upon  their  own  unique  experiences,  preferences,  or  perhaps 
even  biases.  It  Is,  therefore,  Incimfeent  upon  military  managers  and  training  personnel  to  be 
aware  of  the  spectrum  of  available  maintenance  simulator  alternatives,  lest  they  be  convinced  by 
vendors  and  others  that  only  one  type  of  simulator  will  meet  their  training  needs.  An  effective 
taxonomy  for  maintenance  simulators  would  go  a  long  way  toward  eliminating  the  existing  confusion. 

Perhaps  the  most  common  research  method  for  classifying  maintenance  simulator  devices  Is  by 
using  some  form  of  fidelity  dimension.  Rouse  (1982-83)  defined  fidelity  as  "the  precision  with 
which  the  simulator  reproduces  the  appearance  and  behavior  of  the  real  equipment"  (p.  104).  Hays 
(1981)  proposed  a  similar  definition:  the  degree  of  similarity  between  the  training  simulator 
and  the  equipment  being  simulated  In  terms  of  Its  physical  and  functional  characteristics.  Hays 
further  noted  In  his  extensive  literature  review,  a  wide  diversity  of  terms  being  employed  by 
simulator  researchers.  Nevertheless,  there  appeer  to  be  two  basic  types  of  fidelity:  physical 
and  non-physical.  The  most  mfelguous  or  difficult  to  define  Is  the  non-physical-fidelity 
construct.  Psychological  fidelity,  functional  fidelity,  task  fidelity,  end  behavioral  fidelity 
are  among  the  terms  used  for  this  complex  construct  (Hays,  1980).  Unfortunately,  research 
taxonomic  definitions  derived  from  these  constructs  tend  to  be  context  specific  and  often  Involve 
the  use  of  complex  psychometric  measures.  In  summary,  trainers  and  managers  have  little  or  no 
pragmatic  use  for  taxonomic  schemata  based  jon  such  constructs. 

The  Air  Force  Human  Resources  Laboratory  (AFHRL),  In  conjunction  with  Applied  Science 
Associates,1  has  developed  a  maintenance  simulator  taxonomy  based  on  both  the  physical  and 
functional  characteristics  of  computer-driven  maintenance  simulator  trainers.  This  taxonomy  was 
especially  designed  for  use  by  managers  and  trainers.  Maintenance  simulators  can  be  categorized, 
from  the  highest  to  the  lowest  fidelity  trainer,  as  follows:  (a)  Stimulated  Actual  Equipment, 
(b)  Model  Simulators,  (c)  Panel  Simulators,  and  (d)  Interactive  Video  Display  Trainers  (IVDTs). 

Stimulated  Actual  Equipment  (SAE)  Is  equipment  stimulated  or  directed  by  a  computer  and/or 
other  Interface  devlce(s).  In  many  cases.  It  may  be  difficult  to  perceive  the  difference  between 
the  simulator  trainer  and  the  actual  equipment.  SAE  simulators  typically  consist  of  actual 
equipment  components  (racks,  cabinets,  dials,  testing  devices,  etc.),  some  Interface  devices,  and 
a  signal  generator  (or  source  for  signal  Input;  e.g.,  from  a  computer  disk).  Unlike  the  actual 
equipment,  an  SAE  trainer  does  not  receive  Its  Input  from  real  equipment  devices  such  as  line 
replaceable  units  (specialized  electronic  boxes)  but  rather,  from  a  computer-generated  signal 
source  via  some  Interface  derlce(s).  This  generated  signal  source  Is  typically  controlled  such 
that  specific  signals  are  sent  only  under  certain  conditions. 


1  This  maintenance  simulator  research  was  accomplished  under  Contract  No.  F33615-78-C-0019 
with  Applied  Science  Associates,  Valencia,  PA  16059. 
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Model  simulators  are  like  SAE  trainers  In  that  portions  of  the  simulator  are 
three-dimensional  replicas  of  the  actual  equipment.  However,  unlike  SAEs,  aode!  simulators 
typically  contain  operational  replicas  only  for  those  dlspleys  and  controls  essential  to  the 
tasks  being  trained.  Nonessentlal  dlspleys  or  controls  (dials,  lights,  racks,  levers,  etc.)  are 
represented  visually  by  etched  drawings  or  nonfunctional  dlspley  s/controls.  Although  Model 
simulators  are  typically  full-scale  woe k -ups  of  actual  equipment,  they  can  also  be  under-  or 
over-scaled  units  that  meet  certain  training  needs.  Like  all  simulator  devices  addressed  In  this 
study,  model  trainers  are  supported  by  a  microcomputer  that  drives  the  simulation  exercises. 

Panel  simulators  resemble  actual  equipment  even  less  than  model  simulators,  since  a  large 
portion  of  system  components  may  be  entirely  omitted  or  merely  represented  by  grapM c/etched 
drawings  on  a  flat  panel  device.  A  typical  panel  simulator  would  have  full-size  components  (some 
functional  and  others  represented  by  graphic  drawings),  with  drawings  depicting  the  location  of 
those  components  as  they  appear  on  the  real  equipment.  Various  actual  test  equipment  devices 
(e.g.,  otmmmter,  oscilloscope,  voltmeter)  may  be  built  Into  the  flat  panel,  along  with  various 
test  points  for  testing  of  system  components  associated  with  that  particular  weapon,  aircraft,  or 
equipment  system*  As  In  the  model  simulator,  nonessentlal  dlspleys  of  controls  are  represented 
visually  by  etched  drawings  or  nonfunctional  control s/dlsplqys.  Also,  panels  can  be  used  to 
represent  large  units  reduced,  small  units  enlarged,  or  full-scale  units.  Multiple 
Interchangeable  panels  depicting  different  systems  (e.g.,  radar,  navigation,  hydraulic)  are  also 
a  prevalent  feature  of  panel  trainers.  In  general,  panel  simulators  are  selected  for  training 
when  It  Is  desirable  to  have  a  student  practice  on  a  device  that  resembles  certain  equipment 
components  In  appearance,  but  does  not  require  that  many  of  the  systems  and  components  be  either 
present  or  actual  In  size. 

Unlike  the  other  types  of  simulator  trainers,  with  IVDTs,  the  ability  to  perceive  or 
physically  touch  an  actual-size  component  Is  not  an  1m>ortant  consideration.  IVDTs  are 
simulators  that  utilize  computer-generated  graphics  or  computer-controlled  videodisc  Images,  or  a 
combination  of  these,  and  display  equipment  systems  or  components  on  a  cathode-ray  tube  (CRT) 
monitor.  An  IVDT  typically  consists  of  a  microprocessor,  a  video  display  monitor,  an  Input 
device  (e.g.,  light  pen,  touch  panel,  keyboard,  joystick),  and  sometimes  a  videodisc  player  that 
generates  still  or  motion  displays.  Although  the  videodisc -based  IVDTs'  pictorial  clarity  Is 
high,  the  component  size  distortion  due  to  CRT  screen  size  limitations  Is  frequently 
substantial.  IWTs  may  also  be  difficult  to  distinguish  from  Computer-Based  Training  (CBT) 
systems  on  the  basis  of  hanteare,  since  CBT  systems  many  times  use  the  same  hardware.  A  better 
way  of  differentiating  between  the  two,  although  more  difficult  to  assess.  Is  on  the  basis  of 
their  computer  software  or  simulation  characteristics.  In  essence,  IVDTs  employ  sophisticated 
computer  algorithms  to  acco^illsh  fairly  complex  types  of  simulations.  On  the  other  hand,  the 
more  sophisticated  CBT  authoring  systems  do  possess  the  capability  to  develop  simple  types  of 
simulation. 

It  should  be  noted  that  these  classifications  may  not  be  completely  Independent.  A  few 
maintenance  simulators  might  be  considered  ahybr1dsB  of  the  above  simulator  types  (e.g.,  a 
simulator  that  utilizes  both  a  model  and  separate  panels).  In  such  cases,  the  Instructional 
features  and  characteristics  of  both  could  apply.  Despite  the  potential  for  some  overlap,  this 
classification  schema  appears  to  be  far  more  objective  and  meaningful  for  managers  and  trainers 
than  those  developed  by  other  research  studies. 

Despite  their  varying  capabilities,  probably  one  of  the  most  Important  considerations  In 
selecting  the  type  of  trainer  for  a  particular  application  Is  cost.  In  one  AFWL  contract 
stu^y,1  cost  data  were  obtained  on  16  simulators  (three  IVDTs,  five  Panels,  four  Models,  and 
four  SAEs)  that  were  used  to  train  maintenance  technicians  during  the  January  1984  through  June 
1984  time  period.  Figure  1  shows  a  representation  of  the  mean  acquisition  costs  for  the 
different  types  of  maintenance  simulators,  arranged  from  the  lowest  to  the  highest  fidelity 


trainer  type.  The  lowest  mm  acquisition  cost  was  approxlMtely  $23,000  for  IVDT  simulators; 
the  highest  was  $2,000,000  for  SAEs.  The  average  per  unit  costs  for  Panel  and  Model  trainers 
were  $377,000  and  $833,000,  respectively.  These  data  Indicated  that  the  higher  the  trainer's 
fidelity,  the  more  expensive  It  was  to  acquire.  Although  this  study's  sample  size  was  small 
(because  cost  InforMtlon  Is  difficult  or  Impossible  to  obtain  on  Mny  simulator  trainers),  this 
saM  fidelity-cost  relationship  has  also  been  substMtlated  by  AFML  In  other  more  experimentally 
oriented  research  (Clcchlnelll,  Harmon,  I  Keller,  1982;  Pleper,  Richardson,  Harmon,  Keller,  A 
Massey,  1984). 


NalntMance  simulators  continue  to  Increase  In  their  l^iortance  and  range  of  training 
applications  because  of  several  significant  factors.  They  are  more  advantageous  than  the  Actual 
EquIpmMt  Trainers  (AETs)  -  actual  equipment  being  used  as  a  trainer  -  In  that  "they  reduce 
costs,  are  Mre  reliable,  provide  safer  training,  and  have  greater  capability  to  Insert 
Mlfunctlons*  (Jarvis,  Winter,  A  Bucclarelll,  1983).  In  terms  of  acquisition  costs,  Orlansky  and 
String  (1981)  have  found  that  the  acquisition  cost  was  substantially  less  for  maintenance 
simulators  than  AETs.  They  found  that  the  Initial  developMnt  and  fabrication  of  the  Initial 
prototype  was  60S  of  the  AET  cost  In  7  of  11  cases,  with  additional  fabricated  units  costing  less 
than  20S  of  the  AET  cost  In  9  of  the  11  cases  examined.  (Figure  1  data  suggest  that  the 


Acquisition  cost  would  be  a  function  of  the  type  of  trainer  acquired.)  In  more  experimentally 
oriented  studies  (Clcchlnelll  et  al.,  1982;  Pleper  et  el.,  1984).  both  acquisition  and 
maintenance  logistical  support  costs  were  found  to  be  much  lower  for  maintenance  simulators  than 
for  AETs.  Pleper  also  demonstrated  that  an  IVDT-type  trainer  was  superior  to  the  AET  In  training 
troubleshooting  skills.  In  view  of  the  many  advantages  and  cost  benefits,  as  well  as  the  rapid 
geometric  Increase  In  weapon  sophistication.  It  Is  anticipated  that  maintenance  simulator 
trainers  will  continue  to  proliferate  and  Increase  In  Importance  In  the  military  training 
environment. 

Does  this  Imply  that  managers/trainers  should  rush  out  and  procure  a  maintenance  trainer?  If 
the  answer  Is  "Yes,*  one  should  perform  an  adequate  front-end  analysis  and  become  familiar  with 
the  complex  procurement  aspects  of  obtaining  effective  training  devices.  Maintenance  trainers, 
when  not  properly  designed  and  procured,  can  be  more  of  a  training  liability  than  a  tra  nlng 
assetl  The  following  AFHRL  documents  may  be  helpful  to  those  desiring  to  procure  such  trainers: 


Maintenance  training  equipment:  Design  specification  based  on  Instructional 


Development  (AFHRL-TP-84-43.  AD-A149  405). 


System 


Maintenance  training  simulators:  Logistical  support  cost  considerations  In  design  and 


handbook  ( AFHRL -TP-84-44,  AD-A154  108). 


Indeed,  the  acquisition  of  effective  simulator  trainers  Is  no  simple  endeavor;  It  requires  a 
great  deal  of  time,  hard  work,  and  specialized  knowledge. 

This  paper  has  covered  only  one  small  aspect  of  maintenance  simulator  acquisition:  Initial 
acquisition  cost  based  on  simulator  taxonomic  type.  Evidence  suggests  that  simulators  will 
become  Increasingly  more  prevalent  among  all  the  Armed  Services  In  meeting  training  and  defense 
readiness  requirements  In  the  future.  Nevertheless,  the  most  Important  question  Is,  "How 
effectively  will  y  be  procured?*  As  manpower,  equipment,  and  funding  resources  become  ever 
more  limited,  the  need  to  maximally  optimize  defense  resource  allocations  Is  mandatory.  The 
procurement  decisions  of  today's  managers  and  training  personnel  will  sowing  the  seeds  for  the 
future  growth  or  demise  of  an  exceptionally  promising  technology  -  Maintenance  Simulators. 
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